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Abstract 



Decode-and-forward (D-F) and compress-and-forward (C-F) are two fundamentally different relay strategies 
proposed by (Cover and El Gamal, 1979). Individually, either of them has been successfully generalized to multi- 
relay channels. In this paper, to allow each relay node the freedom of choosing either of the two strategies, we 
propose a unified framework, where both the D-F and C-F strategies can be employed simultaneously in the network. 
It turns out that, to fully incorporate the advantages of both the best known D-F and C-F strategies into a unified 
framework, the major challenge arises as follows: For the D-F relay nodes to fully utilize the help of the C-F relay 
nodes, decoding at the D-F relay nodes should not be conducted until all the blocks have been finished; However, 
in the multi-level D-F strategy, the upstream nodes have to decode prior to the downstream nodes in order to help, 
which makes simultaneous decoding at all the D-F relay nodes after all the blocks have been finished inapplicable. 
To tackle this problem, nested blocks combined with backward decoding are used in our framework, so that the 
D-F relay nodes at different levels can perform backward decoding at different frequencies. As such, the upstream 
D-F relay nodes can decode before the downstream D-F relay nodes, and the use of backward decoding at each 
D-F relay node ensures the full exploitation of the help of both the other D-F relay nodes and the C-F relay nodes. 
The achievable rates under our unified relay framework are found to combine both the best known D-F and C-F 
achievable rates and include them as special cases. 

I. Introduction 

The relay channel, originally proposed in Q]|, models a communication scenario where there is one or 
more relay nodes that can help the information transmission between the source and the destination. The 
simplest one-relay channel is depicted in Fig.[T] where nodes 0, 1, and 2 are the source, the relay, and the 
destination, respectively. Two fundamentally different relay strategies have been developed in [j2] for such 
channels, which, depending on whether the relay decodes the information or not, are generally known as 
decode-and-forward (D-F) and compress-and-forward (C-F) respectively. 



Fig. 1. The single-relay channel. 

A. D-F and C-F for single-relay channels 

In the D-F relay strategy, the relay first decodes the message sent by the source and then forwards it to 
the destination, and the destination decodes the message taking into account the inputs of both the source 
and the relay. With the D-F relay strategy, the following rate is achievable: 
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R < max 

p(x ,xi) 




(1) 



2 



where, the first condition R < I(Xq;Yi\Xi) makes node 1 able to decode the message based on the 
signal transmitted by node 0, and the second condition R < I(X ,Xi, Y 2 ) makes node 2 able to decode 
the message based on the signals transmitted by node and node 1 together. Notably, the maximization 
in ([I]) is over p(x ,xi), rather than p(x )p(xi), which suggests that ([I]) can only be achieved by node 
and node 1 cooperating with each other when transmitting signals. To accomplish such cooperation, 
an essential technique called block Markov coding was employed in the D-F coding scheme developed 
in Q. Besides, the scheme in [|2) also used irregular encoding with codebooks of different sizes at the 
source and at the relay, random partitioning (binning), and successive decoding. Subsequently, some other 
D-F coding schemes also achieving ([T]) were found in 

In contrast, the C-F relay strategy is used when the relay cannot decode the message sent by the source, 
but still can help by compressing its observation Y\ into Y\, and forwarding this compressed version to 
the destination. The destination then either successively or jointly decodes the compression of the relay's 
observation and the original message of the source. In the original C-F scheme of the decoder performs 
successive compression-message decoding, i.e., it first decodes the compression of the relay's observation, 
and then decodes the original message of the source, leading to the following achievable rate: 

R< max /pr ;yi,Y 2 |Xi) (2) 

p(x )p(xi)p(y 1 \yi,xi) 

such that I(Y i; YilXu Y 2 ) < I{X x] Y 2 ), (3) 

where ^ ensures that the compression Y\ can be first recovered at the destination, and ^ ensures that 
the destination can decode the original message X based on Y\ and Y 2 together. 

The two-step compression-message successive decoding process in [|2|| requires Y\ to be decoded first, 
which facilitates the decoding of X , but is not a requirement of the original problem. Recognizing this, 
a joint compression-message decoding process was proposed in [5|, where, instead of successively, the 
destination decodes Yi and X together. It turns out that the decoding of X can be helped even if Yi 
cannot be decoded first. In fact, with joint decoding, the constraint ([3]) is not necessary, and instead of 
([2]), the achievable rate is expressed as 



R< max I(X o ;Y 1 ,Y\X 1 )-max{0,I(Y 1 ;Y 1 \X 1 ,Y)-I(X 1 ;Y)} 

p{x )p(x 1 )p(y 1 \y 1 ,x 1 ) 



(4) 



Therefore, compared to successive decoding, joint compression-message decoding provides more freedom 
in choosing the compression Y±. However, the question remains whether joint decoding achieves strictly 
higher rates for the original message than successive decoding. For the single relay case, it was proved 
in (81 that the answer is negative, and any rate achievable by either of them can always be achieved by 
the other, i.e., the achievable rates in @-((3]) and (|4]) are essentially the same. In fact, as we will see later 
in the Introduction, when C-F is generalized to the case of multiple relays, there is no improvement on 
the achievable rate by joint decoding either. 

Combining the D-F and C-F together, one can further consider the hybrid scheme, e.g., [|2l Thm 7], where 
the relay partially decodes the message and compresses the rest of its received signals. However, such 
hybrid schemes generally involve superposition coding that induces auxiliary random variables, making 
the expression and evaluation of the achievable rates rather complicated especially in the case of multiple 
relays that we will consider in the sequel. Thus, in this paper, our discussion focuses on the "pure" D-F 
or C-F strategies only, i.e., the strategies where the relay either completely decodes the message, or does 
not decode at all but simply compresses and forwards its observation. 

B. D-F and C-F for multi-relay channels 

A natural extension of the single -relay channel in Fig. [T] is to the case of multiple relays depicted in 
Fig. [2j where nodes and n+1 are the source and the destination respectively, and nodes 1, 2, . . . , n are 

'Similar formulas as ^ have been derived with different arguments in t6l-t8l. 
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the n relay nodes that constitute the relay nodes set, denoted by J\f. Both the D-F and C-F relay strategies 
have been separately generalized to such multi-relay channels in ll9l- lfT8ll , among which, lfT2l - |fl"5l and 
|fT6ll - |fT8l provide the best achievable rates for D-F and C-F respectively. 

Specifically, in generalizing D-F to the multi-relay channel, lTT2l - [[T3l modified the original irregular 
encoding/successive decoding scheme of 13 to a regular encoding/sliding window decoding scheme to 
realize the "multi-level" D-F relay strategy. For any fixed permutation it on {0, 1, . . . , n + 1} with 7r(l) = 
and 7r(n + 2) = n + 1, i.e., any specific ordering of the relay nodes as 7r(2),7r(3), . . . ,7i(n + 1), their 
multi-level D-F scheme |[T2l - [[T3l achieves the following rate: 

R < max min I(X n n :k - 1 y,Y 7r f k )\X 7r fk:n+i)), (5) 

p(x ,xi,...,x„) 2<fc<n+2 

where -n(ki : k 2 ) : = {n(ki),n(ki + 1), . . . ,7r(/c 2 )}. Later on, it was found in [fT4l - lTT5l that ^ can also 
be achieved with backward decoding. 

The formula ^ has a similar interpretation as ([I]). For each node 7i(k),k = 2,3,...,n + 2, the 
corresponding rate constraint is 

R < I {X^l-.k-l)] K-(fe)|^7r(fc:n+l))) (6) 

which implies that for the decoding at node n(k), the signals transmitted by nodes n(k + 1 : n + 1) 
are known a priori, and the signals transmitted by nodes 7r(l : k — 1) are cooperating in providing the 
information. A simple explanation of this feasibility is the following. In the multi-level D-F relay strategy, 
information is passed along the route 7r(l) — > n(2) —>••-•—)■ ix{n + 2), so that i) any information obtained 
by the downstream nodes of 7i(k), i.e., nodes ix{k + 1 : n + 1), has already been obtained by node %(k), 
and therefore their inputs are predictable by node n(k), and ii) by the time the information reaches node 
7i(k), all its upstream nodes 7r(l : k — 1) have already obtained the same information and can therefore 
cooperate with the technique of block Markov coding. The formula ([5]) also demonstrates a remarkable 
feature of the multi-level D-F relay strategy in [fT2ll - [fT5l , i.e., it completely eliminates the interference in 
the network: To any node, the signal transmitted by any other node is either a "real" signal that can be 
used for decoding, or a priori known signal that can be subtracted completely. 
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Fig. 2. The multiple-relay channel. 

In the line of generalizing C-F to multi-relay channels, substantial advances have been recently made in 
lfT6ll - lfT8l . First, in [fT6l . a new C-F scheme termed noisy network coding was proposed. Different from the 
original C-F scheme of [2], where cumulative encoding/block-by-block forward decoding was used, this 
noisy network coding scheme employed repetitive encoding/all blocks united decoding. Besides, it also 
used compression-message joint decoding without uniquely decoding the relays' compressions, instead of 
compression-message successive decoding as in the original C-F scheme. It turns out [fT6ll that the noisy 
network coding scheme achieves the same rate as the original C-F scheme for the single-relay channel, 
but improves the original C-F scheme in the case of multiple relays to achieve higher rates as follows: 

R < max min J(X , X s ; Ym\ s , Yn+^X^s) - I{Y S ; Y S \X , X Af , Y n+1 , VV\ 5 ). (7) 

p( x o) iT=i p(xi)p(yi\yi,Xi) S ^=N 
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However, soon in [fT71 - [fT8ll . it was discovered that neither repetitive encoding/all blocks united decoding 
nor compression-message joint decoding used in [16] is necessary to achieve the rate ([7]); in particular, a cu- 
mulative encoding/block-by-block backward decoding/compression-message successive decoding scheme 
was developed, and its corresponding achievable rate was shown to be the same as ([7]), with the following 
form: 

R< max I(X ;Y x ,Y n+1 \X x ) (8) 

p(xo)Tli=iP( x i)p(yi\ x t,yi) 

such that I(X S ; Y X \ S , Y n+1 \X M \ S ) ~ I(Y S ; Y S \X M , Y n+1 , Y X \ S ) > 0, \/S C Af, (9) 

where @-((9]) can be similarly interpreted as ([2])-([3]) for the single-relay case, i.e., Q ensures that the 
relays' compressions can be first recovered at the destination, and (8J) ensures that the destination can 
decode the original message of the source based on Y n+ i and Y^ together. Note that the rate equivalence 
between <j7]) and @-((9]) also demonstrates that in the case of multiple relays, there is no improvement on 
the achievable rate by joint compression-message decoding either, which is consistent with the conclusion 
made in the single -relay case. More interestingly, in proving such a rate equivalence, lfT71 - lfT8l found that 
the the R.H.S. (right-hand- side) of (7| is maximized only when the compressions are chosen to satisfy 
Q, i.e., to maximize the achievable rate for the original message, the compressions should always be 
chosen to support successive decoding, and any compressions not supporting successive decoding will 
actually lead to strictly lower achievable rates for the original message. 

Since block-by-block backward decoding and compression-message successive decoding are relatively 
easier to implement than all blocks united decoding and compression-message joint decoding respectively, 
the cumulative encoding/block-by-block backward decoding/compression-message successive decoding 
scheme of lfT71l - lfT8l becomes the simplest choice in achieving the highest C-F rate in the case of 
multiple relays. Moreover, the fact that this scheme achieves the same rate as noisy network coding 
also reveals the essential reason for the improvement of the achievable rate - not repetitive encoding/all 
blocks united decoding, not joint compression-message decoding, but delayed decoding until all the blocks 
have been finished. This delayed decoding is generally necessary because the multiple-relay case differs 
from the single-relay case in that it may take multiple blocks for the relays to help each other before 
their compressions can finally reach the destination. Hence, the block-by-block forward decoding scheme, 
which is sufficient for the single-relay case, may not work satisfactorily for multiple relays in general 

ttH. 

It is worth noting that although the optimal C-F rate is achieved only when the compressions are chosen 
to support successive decoding in single-destination networks, in a network with multiple destinations 
( lfl6l . lfT8lO . the compressions may not be chosen to support successive decoding at all the destinations, 
and joint decoding might have to be used. For this, a more general scheme of cumulative encoding/block- 
by-block backward decoding/compression-message joint decoding was developed in lfT8ll . For any given 
distribution p(x ) Y\% =1 p{xi)v{i)i\ x iiyi)> this scheme achieves the following rate: 

R < min I(X , X s] Y v \ s , Y n+1 \X v \ s ) - I(Y S ; Y S \X , X v , Y n+1 , Y V \ S ), (10) 

o c_ u 

where V is the unique largest subset of Af satisfying 

I(X s ;Y v \s,Y n+1 \X ,X v \ s ) - I(Y s ;Y s \X ,X v ,Y n+1 ,Y v \ s ) >0,V5CP,5^ 1 (11) 

and Yp can be decoded jointly with X . Here, V can be interpreted as the "jointly decodable" relay nodes 
set such that the compressions of the relays in this set are decodable jointly with the original message X . 
In contrast, the compression of any relay node in Af \ V is not decodable even jointly with X , where 
V is the unique largest subset of Af satisfying 

I(X s ;Y v ,\ s ,Y n+1 \X ,X v ,\ s ) - I(Y s -Y s \X ,X v ,,Y n+1 ,%,\s) > 0,V5 C V . (12) 
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On the other hand, for any given distribution p(x ) Y\4=xP{ x i)p{Vi\ x iiVi)-' tne achievable rate ^ can 
be more generally expressed as 

R < minI{X ,X s -,Yr\s,Y n+1 \Xr\ S ) - I(Y s ;Y s \X ,X T ,Y n+1 ,Y n s) 03) 

if we only consider a subset of relays T C J\f for the decoding, while treating the other inputs as purely 
noise. Interestingly, it was found in lfT8l that among all the choices of T C J\f, the R.H.S. of (fT3]) is 



maximized when T = V or T = V , but is strictly less than the maximum when T ^ V . Therefore, 
only those relays whose compressions are jointly decodable are helpful to the decoding of the original 



message, and including the jointly un-decodable compressions in the formula (13), i.e., choosing T ^ V, 
will even strictly lower the achievable rate. 



By comparing (10) and (13) with T = T>, it can be concluded that for any compressions chosen at the 
relays, the cumulative encoding/block-by-block backward decoding/compression-message joint decoding 
scheme of [fT8ll achieves the same rate as the noisy network coding scheme [16J0 



C. A unified relay framework with both D-F and C-F relay nodes 

In the above discussions, all the relay nodes in the network perform only one type of relay strategy, 
either D-F or C-F. However, to obtain higher achievable rate, it might be better to let each relay node 
choose from D-F and C-F its relay strategy depending on the channel condition, e.g., let the relay node 
close to the source perform D-F while let the relay node close to the destination perform C-F. This 
invokes a unified relay framework that includes both the D-F and C-F relay nodes in the network. In 
developing such a framework, one naturally wants to combine the advantages of both the best known D-F 
and C-F schemes, i.e., the multi-level D-F schemes in lfT2l - lfT5l and the recent advances on C-F schemes 

m Una-ma. 

An attempt towards this unified relay framework has been recently made in [|2T|. In the scheme of 
[1211 . part of the relay nodes use D-F and the rest use C-F, and the D-F relay nodes exploit the help of 
the C-F relay nodes via offset coding. However, the scheme in [21 J failed to take full advantage of the 
best known D-F and C-F strategies. Firstly, [21] didn't use the multi-level D-F schemes as in |[T2l - [[T5l . 
Instead, all the D-F relay nodes in the scheme of [|2T| are at the same level, and thus the decoding at 
each D-F relay node couldn't exploit the help of other D-F relay nodes. Secondly, in ETTl . although the 
destination performed backward decoding to fully exploit the help of the C-F relay nodes, the decoding 
at each D-F relay node was based on two consecutive blocks only and thus didn't fully utilize the help 
of the C-F relay nodes as in lfT6l - lfT8ll . (Note as mentioned in Part B, in the case of multiple C-F relay 
nodes, delayed decoding after all the blocks have been finished is in general necessary.) 

Indeed, it turns out that, to fully incorporate the advantages of both the best known D-F and C-F relay 
strategies into a unified framework is nontrivial due to the following major challenge: For the D-F relay 
nodes to fully utilize the help of the C-F relay nodes as in [fT6ll - [fT8l . decoding at the D-F relay nodes 
should not be conducted until all the blocks have been finished; However, to perform the multi-level D-F 
strategy as in [[T2 l - [fT5l . the upstream nodes have to decode prior to the downstream nodes in order to 
help, which makes simultaneous decoding at all the D-F relay nodes after all the blocks have been finished 
inapplicable. 

To tackle this problem, nested blocks ( [IT4l -[fT5l. 112210 combined with backward decoding are used in 
our framework, so that the D-F relay nodes at different levels can perform backward decoding at different 
frequencies: the closer to the source in the information passing route, the higher decoding frequency. 
As such, the upstream D-F relay nodes can decode before the downstream D-F relay nodes and the 
destination, and the use of backward decoding at each D-F relay node ensures the full exploitation of the 
help of both the other D-F relay nodes and the C-F relay nodes. 

2 Part of the results in 1 1 71 - 1 1 81 have also been recognized in |19|-|20|. 
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Specifically, we partition the relay nodes set N into two sets, Ai with \M. \ = M and N\AA, as depicted 
in Fig. [3j and fix some permutation n on {0} |J M. [_]{n + 1} with 7r(l) = and 7r(M + 2) = n + 1. Let 
the relay nodes in Ai perform the multi-level D-F cooperatively along the route 7r(l) — > n{2) —)■•••—>■ 
7r(M+2), while let each node i 6 Af\M performs C-F as in flT6]| - flTHJ independently. Then, a total of B M+1 
blocks will be used and the length of a "virtual" block for node n(k), k = 2, 3, . . . , M + 2, will be B k ~ 2 . 
The backward decoding at the destination, i.e., node n(M + 2), will happen at the end of all B M+1 blocks, 
while the backward decoding at the D-F relay node 7r(A;), k = 2, 3, . . . , M + 1, will happen whenever it 
has received B new "virtual" blocks, i.e., at the end of each block b = vB k ~ x , v E [1 : B M+1 / B k ~ x \. Also, 
both the D-F relay nodes and the destination will perform compression-message joint decoding, which 
is in general necessary since the compressions of the C-F relay nodes may not be chosen to support 
successive decoding at all the D-F relay nodes and the destination. 

Under the above described framework, for any given distribution p(x )p(xm \x ) YiieXXM P( x i)p(Vi \Vii 
the following rate is achievable: 

R < min min J(X 7r (i :fc _i), X$; Yv k \s, Yir(k)\Xv k \s, X^k-.M+i))— KXs] YsIX^um+i), Xv k , Y n ( k ), Yv k \s) 

2<&:<Af+2 SQT) k 

(14) 

where V k is the unique largest subset of J\f \ M. satisfying 



I{X S ] Yx> k \Si YK(k)\Xir(l:M+l), Xx> h \s) ~ I(Ys] Ks|^7r(l:M+l)> Xx> k , Y-n{k)i Yv k \s) > 0, 

for any nonempty S C V k . 



(15) 



7r(l)/0/ tt(2) tt(3) 



w(M) 7r(M + l)\7r(A/ + 2)/n+l 




Af\M (C-F) 



Fig. 3. A unified relay framework with both the D-F and C-F relay nodes. 



( fl4| ) has the flavors of both ^ and ([To]). Specifically, for each node 7r(k), k = 2, 3, . . . , M + 2, the 
corresponding rate constraint is 

R < min I(X n (i : k-i), X s ; Yx> k \s, Yir(k)\Xv k \s , X n ( k:M +i))— I(Y S ; Y s \X n (i :M +i), Xx> k , K-(fc), Yv k \s), (16) 
scv k 



which is in a form similar to (10) but with the appearance of -^(ltfe-i)* X^ik-.M+i) an d -^7r(i:M+i)- ( 1 6 > has 
the similar form as (10) since node n(k) uses the help of the C-F relay nodes as in ifTTll - lfTSTl . ^(lrfc-i), 
X^ik-.M+i) an d ^tt(1:M+i) appear in ( 16) because node n{k) also utilizes the help of other D-F relay nodes 
as in [[T2 l |- [fT5l so that the signals of its upstream nodes, i.e., X^i-.k-i), are cooperatively providing the 
information while the signals of its downstream nodes and itself X^fk-.M+i) are known at n(k). Also, the 
set V k defined in (fT5l has a similar interpretation as the set V defined in (fTTI), i.e., the "jointly decodable" 



C-F relay nodes set at node ir(k) such that the compressions of the relays in this set are decodable jointly 
with X % (i : k-i) given that X^-m+i) are known at node -n{k). 
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It can be easily seen that (14) includes the achievable rates in ([5]) and ( [TO] ) as special cases: When 
M — N, i.e., all the relays perform D-F, V k = and ([14]) reduces to When M = ®, i.e., all the 
relays perform C-F, ([141) re d uces to (flO|). 



Finally, it should be noted that, the achievable rate ( 14) is proved by using the block-by-block backward 
decoding scheme in [18]. We can also modify the all blocks united decoding scheme in lfl6l to a B- 
blocks-by- 73-blocks backward decoding scheme, to fit it into our unified relay framework and prove the 
following achievable rate: 



R < min max min I(X^n,k-i),Xs]Y T \ s ,Y^f k \\Xr k \S:X^(k, M+ i)) 



-I{Ys\Y s \X, 



w(l:M+l), Xj- k , Y, 



7r(fc) 

(17) 

Similarly to the equivalence between (10) and (13), here ( fl4| ) and ( [17] ) are also equivalent. One can also 
easily check that (17) includes the achievable rates in ([5]) and (13) as special cases by letting M. = N 
and M. = respectively. Notably, again, in terms of complexity, block-by-block backward decoding is 
relatively easier to implement since £>-blocks-by-£> -blocks backward decoding involves B blocks united 
decoding. 

The remainder of the paper is organized as the following. In Section [nlwe formally state our problem 
setup and summarize the main results. Then, in Section III and SectionjTv} our unified relay framework 
with block-by-block backward decoding and with 73-blocks-by-/3-blocks backward decoding will be 
presented in detail respectively. Finally, some concluding remarks are included in Section [VJ 



Y-, 



T k \Sj 



II. Main Results 

Consider a multiple-relay channel consisting of n + 2 nodes, as depicted in Fig. [2j where nodes and 
77 + 1 are the source and the destination respectively, and nodes 1, 2, . . . , n are the n relay nodes. Formally, 
this channel can be denoted by 

(X x X x x • • • x X n , p(y n+h yi, . . .,y n \x ,xi, . . .,x n ), y n+1 x y x x • • • x y n ) 

where, X , Xi, . . . ,X n are the transmitter alphabets of the source and the relays respectively, y n +i, 3^i, • • • , 34 
are the receiver alphabets of the destination and the relays respectively, and a collection of probability 
distributions p(-, . . . , -\x , xi, . . . , x n ) on 34+i x 3^ x • • • x y n , one for each (a;o, Xi, . . . , x n ) G X x 
X\ x • • • x X n . The interpretation is that xo is the input to the channel from the source, y n +i is the output 
of the channel to the destination, and yi is the output received by the 7-th relay. The 7-th relay sends an 
input Xi based on what it has received: 

Xi{t) = r itt (yi(t - 1), yi(t - 2), . . .), for every time t, (18) 

where r ijt (-) can be any causal function. 

Before presenting the main results, we introduce some simplified notations. Denote the set J\f = 
{1,2,..., n}. For any subset S C {0, 1, . . . , n + 1}, let X$ = {Xi, i E S}, and use similar notations 
for other variables. For any M. C J\f with \M.\ = M, let 7r({0, .M, 77 + 1}) be a permutation on 
{0}U- A/ *U{™+ 1 } withTT(l) = 0and7r(M+2) = n+1, and let tt(A; 1 : k 2 ) = {7r(Jfei), 7r(Jfei+l), . . . , tt(A; 2 )}. 



Under our unified relay framework as described in the Introduction, the following Theorems |2 . 1 1 and |2 . 2| 
present the achievable rates by block-by-block backward decoding and £>-blocks-by-£>-blocks backward 
decoding respectively. The coding schemes used to prove these theorems constitute the key contributions 



of our paper, and will be presented in detail in Sections III and IV respectively. 

Theorem 2.1: For the multiple -relay channel, a rate R is achievable if for some M. C M with \M. \ = M, 
there exists a permutation 7r({0,A^,r7 + l}) and some 

p(q)p(x \q)p(x M \x ,q) JJ P( x i\l)p(yi\yi, x h ?) , 

i£Af\M 
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such that for any k = 2, 3, . . . , M + 2, 

R < mm I{X^x:k-l)i ^S] YT> k \Si Y^^\Xx> k \Si ^n(k:M+l), Q) ~ I(Ys'i ¥s\X n (l:M+l), ^X> fe , ^D^S, Q)j 

(19) 



where V k is the unique largest subset of J\f \ A4 satisfying 

nXs)Yv k \S,Yn(k)\X* K (l-.M+l), Xx> k \S, Q) — I(Xs') Xs\^tt(1:M+1), ^V k i ^Tr(fc)) ^V k \Si Q) > 0, (20) 

for any nonempty 5 C Dj.. 

Theorem 2.2: For the multiple -relay channel, a rate R is achievable if for some M. C A/" with |.M | = M, 
there exists a permutation n({0, Ai,n + 1}) and some 

p(q)p(x \q)p(x M \x ,q) ] [ p(xi|g)p(^|^, x i; g), 

ieM\M 

such that for any k = 2, 3, . . . , M + 2, 

i? < max mm /(X 7r (i :A ._i ) , X 5 ; Y n ( k )\X Tk \ s , X^k-.M+i), Q)~ I(Ys\ Ys\^{i-.m+i), Xr k ,Y n ^, Y Tk \ s , Q). 

(21) 



The following theorem establishes the equivalence between the achievable rates in Theorems 2.1 and 
2.2| The proof of this theorem can be immediately obtained by analogy to the proof of lfT8l Thm 2.8] 
and will be omitted in this paper. 

Theorem 2.3: For any M. <Z J\f with \M. \ = M, any permutation 7r({0, A4,n + 1}), any distribution 

p(q)p(x \q)p(x M \x ,q) JJ P( x i\l)p(yi\y^ x h q) , 

i£jV\M 



and any k — 2, 3, . . . , M + 2, the maximum in the R.H.S. of (21 ) is attained when % = T) k , where V 



is as defined in (20). 



Remark 2.1: Finally, we point out that Theorems 2.1 and 2.2 can also be applied to multiple-destination 



problems, by choosing the D-F relay nodes set M. to include the other destinations. 

III. Unified Relay Framework With Block-By-Block Backward Decoding 



To prove Theorem 2.1 we incorporate the multi-level D-F scheme in IU2l - [fT51l and the cumulative 
encoding/block-by-block backward decoding/comression-message joint decoding C-F scheme in lfT8ll into 
the unified relay framework described in the Introduction. 

Specifically, we divide the relay set M into two sets, M. with \Ai \ = M and J\f\JA, as shown in Fig. 
|3j and fix some permutation 7r({0, Ai, n+ 1}) with tt(1) = and n(M + 2) = n+1. The source performs 
cumulative encoding, in the sense that a new message is encoded at the source in each new block; the nodes 
in Ai perform multi-level D-F cooperatively, along the route 7r(l) — > 7r(2) —>■•••—>■ 7r(M+2), in a similar 
manner with [[T2 l - [[T5l : each node i E M\M performs C-F independently in the same way as irT6l - lfT8l : 
both the D-F relay nodes and the destination node, i.e., nodes 7r(2 : M + 2), perform compression-message 
joint decoding in a block-by-block backward manner. (Note here, the nodes 7r(2 : M + 2) will be treated as 
multiple destinations with respect to the C-F relay nodes, and thus compression-message joint decoding is 
generally necessary at the these nodes, as mentioned in the Introduction.) A total of B M+1 blocks will be 
used and the length of a "virtual" block for node n(k), k = 2, 3 . . . , M + 2, will be B k ~ 2 . The backward 
decoding at the destination, i.e., node n(M + 2), will happen at the end of all B M+1 blocks, while the 
backward decoding at the D-F relay node n(k), k = 2, 3, . . . , M + l, will happen at the end of every B k ~ x 
blocks, i.e., at the end of block b = vB k ~\ v e [1 : B M+l /B k ~ l \. 

To make the presentation of the detailed coding scheme easier to follow, we first consider the case of 
single D-F relay node, i.e., when M = 1, and then present the extension to the general case of multiple 
D-F relay nodes, i.e., when M > 2. 
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A. Single D-F relay node (M = 1) 

Assume that, among the relay nodes set J\f, only node 1 is the D-F relay nod e, and all other relay 
nodes are the C-F relay nodes. Denote J\f = M \ {1}. Specializing Theorem |2.l| to this case, we have 
that a rate R is achievable, if there exists some 

p(q)p(x \q)p(x 1 \x , q) JJ p{xi\q)p{yi\y h x u q), 

ieJV 



such that 
R < min 



mm I(X , X s ; Y VAS , Y X \X U X Vl \ s , Q) - I(Y S ; Y S \X , X,,X Vl , Y 1 ,Y- Dl \ s , Q) 

min I(X , X±, X s ; Y Vn+2 \s, Y n+ 2\Xx, n+2 \ s , Q) — I(Y S ; Y S \X , X±, Xv n+2 , Y n+2 , Y Vn+2 \ S , Q) 

(22) 

where V\ is the unique largest subset of Af satisfying 

I(X S ; Y VAS , Y X \X , X h X VAS , Q) - I(Y S ; Y S \X , X u X Vl , Y l: Y Vl \ s , Q) > 0, (23) 
for any nonempty S EV\, and V n+2 is the unique largest subset of Af satisfying 

I{Xs] Yr> n+2 \s, Y n+2 \X , Xi, X Vn+2 \s, Q) — I(Y S \ Y s \Xq, X 1; X Vn+2 , Y n+2 , Y Vn+2 \s, Q) > 0, (24) 

for any nonempty S C V n+2 . 

The uniqueness of V>\ and V n+2 can be immediately obtained by analogy to the proof of |[T8l Thm 



2.7]. Below, we focus on proving the achievablity of the rate in (22). For simplicity of notation, we only 
prove the achievability for the case Q = 0. Achievability for an arbitrary time-sharing random variable Q 
can be obtained by using the standard technique of time sharing [|23l . jH. The same consideration on Q 
applies throughout all the proofs of this paper. 

In the case of single D-F relay node, a total of B 2 blocks will be used. The backward decoding at the 
destination node n + 2 will happen at the end of all B 2 blocks, while the backward decoding at the D-F 
relay node 1 will happen at the end of every B blocks, i.e., at the end of block b = vB,v E [1 : B]. 
Note here, in order to fully utilize the help of the C-F nodes as in |fT6l - |fT8l , even the only D-F relay 
node 1, has to perform backward decoding, which is different from the situation arising in lfT4l - lfT5l and 
[|22l . where there is no issue of exploiting the help of the C-F nodes and node 1 can decode at the end 
of every block. The detailed codebook generation and encoding/decoding process are as follows, which 
can be understood with the help of Table [TJ 

Codebook Generation: Fix p(x )p(xi\x ) Tin^Af P( x i)p(yi\yii x i)- We randomly and independently gen- 
erate a codebook for each block. 

i) First consider the codebook generation for the source node and the D-F relay node 1. A joint 
codebook for these two nodes will be generated in a backward manner similar to [fT3l for each block. 
Specifically, for each block b E [1 : B 2 ], randomly generate 2 TR independent sequences x.i b (m b _ B ) for 
node 1, and randomly generate 2 TR conditionally independent sequences x 0i b(mfc|m;,_B) for node 0, where 
m^vrib-B G [1 : 2 TR ]. As in [13], the codebook is generated in the backward manner because the source 
node knows what the D-F relay node 1 is going to transmit, and therefore can adjust its own transmission 
accordingly, but not the converse. The difference from [13] is that here the delay between the messages 
transmitted by node 1 and node is B blocks, instead of 1 block in |[T3l . since in our framework node 
1 has to wait for every B blocks to perform backward decoding for exploiting the help of the C-F relay 
nodes. 

ii) Then we generate the codebooks for the C-F relay nodes in the same way as in |[T6l - lfT8ll . For each 
block b E [1 : B 2 } and each relay node i E Af, randomly and independently generate 2 TRi sequences 
*-i,b(h,b-i), U,b-\ £ [1 : 2 TRi ], where R { = I(Yi, Y^X^ + e; for each relay node i E Af and each Xj >fc (/ ijf) _ 1 ), 
lib-i G [1 : 2 TRi ], randomly and conditionally independently generate 2 TRi sequences yib(hb\hb-i), 
lib e [1 : 2 T H 
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The combination of i) and ii) defines the codebook for any block b G [1 : B 2 ], 
C b = |xi i6 (m 6 _ B ),x 0i6 (m 6 |m 6 _ i j) : m b ,m b _ B G [1 : 2 TR ]; 

Xi,b(kb-i),yi,b(kb\kb-i) : e [1 : 2 Tfli ],i G A/"}. (25) 

Encoding: Let m = (mi,m 2 , . . . ,m B 2) be the message vector to be sent and let m fe = 1 be the dummy 
message for any 

b G U* =1 [w5 - L + 1 : wB] \J[(B - l)B + 1 : 5 2 ] (26) 

and for any b < 0. As we will see, these dummy messages are inserted to ensure the start of block-by-block 
backward decoding. Due to these dummy messages, the actually achievable rate becomes ^^—^- R, 
which, however, can be made arbitrarily close to R by letting B — > oo for any L. 

TABLE I 

Block-by-Block backward decoding for the single D-F relay node case 



Block 


1 2 


B — L 


S - £ + 1 


s 


X 


xo,l(mi|l) x 0j2 (m 2 |l) 


x O,B-L{rn B _ L \l) 


x 0,B-i + l(l|l) 


*o,b(i|i) 


*1 











(mi, m 2 , . . . , ms) 


X! 


xi.lt 1 ) xi, 2 (l) 


Xl,B-t(l) 


x l,B-t + l(!) 


x ljB (l) 


Y N 




^Sf,B-L^ST,B-L I'a/'.B-L-i) 


^JV'.B-L + I ( l N ,B — i+l I'a!" ,B-L ' 


^U,B^ l M,B \ l M,B-D 


X M 


x A?,lW X Af, 2(^,1' 


X jV,B-i('jV,B-i-l) 


x jV,b-l + i ('at.b-zJ 


x N',b( 1 jv,b-D 


Y n+2 
















Block 


S 2 - B + 1 


B 2 - L 


S 2 - L + 1 


B 2 


X 


x 0,B2-B + l( 1 l m B 2-2B + l) 


x 0,B 2 -t< 1 l m B 2 -B-t) 


x 0,B 2 -t + l( 1 l 1 ) 


X , B 2(1|1) 


Yl 











( m B 2 -B + l'"'' m B 2 ) 


X! 


X 1,B 2 -B + l ( m B 2 -2B+l) 


x l,B 2 -L< m B 2 -B-i) 




x 1b2 (1) 


Y N 


yAf,B 2 -B+l( ! AA,B 2 -B + ll'Af,B 2 -B) 


yAf,B 2 -t< ; Af,B 2 -t V.B 2 -!, 


-l' ^M,B 2 -L+l t J'N,B 2 -L + l ] ' l N,B 2 


-i) '" yjV,B2( ! AA,B2l'jV,B 2 -l) 


X M 


x aa,b 2 -b + i( ! jv-,b 2 -b' 


x AA,B 2 -L( i Ar,B 2 -I,-l) 


x aT,b 2 -i,+i( ! aa,b 2 -l) 


X MT, b2< I JV',b2-i) 


Y„ +2 











(mi , m 2 , . . . , m^ 2 ) 



i) First consider the encoding process for nodes and 1 . 

• In block b G [1 : B 2 ], the source node transmits x. 0ib (m b \m b - B ). 

• At the end of block vB, v G [1 : B\, the D-F relay node 1 has decoded messages 

(m V B-B+i, mvB-B+2, • • • , rn vB ) 

using backward decoding (see the decoding part). In the next B blocks, i.e., in block b G [vB + 1 : 
(v + 1)B], the relay node 1 transmits xi :b (m b ^ B ), where m b _ B for any b G [vB + 1 : (v + 1)B]) has 
been decoded by block vB. 

ii) For any block b G [1 : B 2 ], each relay node i e Af, upon receiving y ij6 at the end of block b, finds 
an index such that 

{Xi,b(k,b-l),yi,b,yi,b(h,b\k,b-l)) £ ^(Aj, Fj, Y$), 

where Z ii0 = 1 by convention. In block 6 G [1 : B 2 ], the relay node % G M transmits x ii6 (Zj )6 _i). 

Decoding: We present the decoding process at the D-F relay node 1 and at the destination node n + 2 
separately. 

i) At the end of block b = vB, v G [1 : -B], the D-F relay node 1 decodes messages 

(rrib-B+i, m b ^ B+2 , m b ) 
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using block-by-block backward decoding. In fact, among these messages, (rrib-L+i,'m>b-L+2, ■ ■ ■ , frib) are 
dummy messages according to (26) and only (m 6 _ B+a , m b _ B+2 , m b ^ L ) need decoding. 

• a) Node 1 first finds the unique lr> x ,b-L — {k,b-L,i G V{\ such that there exists some Ix^b-L+i 
satisfying that for any block j = b — L + l,b — L + 2, 

(X j(mj\mj-B))^ij(^j-B)j{{^ij{hj-i))^ij{hj\hj-i)) '■ i G G A e (Xo, X%, X^fY^jYi). 

(27) 



Note in (27), for any j = b — L + 1, b — L + 2, . . . , b, rrij and mj_ B are both dummy messages 
according to (26), and both 'K j(mj\mj- B ) and Xij(m_j_s) are known at node 1. Then, it follows 
from the proof of [HH Thm 2.7] that lv ly b-L can be decoded if 

I{X S ] Y Vl \ s , Yi\Xqj Xx, Xtj-^s) — I(Ys'iY s \X ,X 1 ,X T , 1 ,Y 1 ,Y Dl \s) > 0, (28) 



for any nonempty S C V> x . 

b) Backwardly and sequentially from block j 



b — L to j — b — B + 1, node 1 finds the unique pair 



(rrij, lx> 1; j-i) satisfying (27), where lv 1; j has already been recovered due to the backward property of 
decoding, and rrij- B has been decoded by block b — B. 

At each block j = b — L,b — L — 1, . . . , 6 — B + 1, error occurs with rrij if the true rrij does 
not satisfy (27) with any l Vl! j-i, or a false rrij satisfies (27) with some According to the 

properties of typical sequences, the true (rrij, £z>ij-i) satisfies (27) with high probability. 

For a false rrij and a lvi,j-i with false {/ij-i, i G 5} but true {lij-i, i G Z>i\<S}, Xo^mjlmj-s) is 
conditionally independent of {(Xjj(Zjj_i), Yij(li j\li : i G and Y x j given Xi^TOj-b); and 
{(Xjj^ij.i), Yij^jjl/ij-.i)) : i G 5} are independent of {(X^-^j-i), Y ^(li^l^x)) : z G T> X \S}, 
~Kij(mj_ B ) and Yij. 

Therefore, the probability that such false (mj,lu u j-\) satisfies (27) can be upper bounded by 

2T(H(Xo,X 1 ,X T , 1 ,Y T , 1 ,Y 1 )+e)2-T(H(X 1 ,Xv 1 \s,Y T , AS ,Yx)-e) 
^ 2 -T{H{X \X 1 )-e) 2 -T(H(X s )-e) 2 -T{j: xeS {H{Y r \X r )-e)) _ 

Since the number of such false (rrij, /x>i j-i) is upper bounded by 2 TR \~[ i&s 2 T ( I ( Yi]Yi \ XiS)+e \ with the 
union bound, it is easy to check that the probability of finding a false rrij goes to zero as T — > oo, if 



R < mm 7(X , X 5 ; F^, F x - I(Y S ; Y S \X , X x ,X Vl ,Y x , Y Vl 



SCVx 



i\S) 



(29) 



Then, based on the recovered rrij-B and lv lt j, again from the proof of [18, Thm 2.7], it follows that 
lv lt j-i can be decoded if (28) holds. 

By a) and b) together, at the end of block b = vB, v G [1 : B\, the D-F relay node 1 can decode 
messages (mj_B+i,%-B+2, • • • , if both (28) and (29) hold, 
ii) At the end of all B 2 block, the destination node n + 2 decodes messages (mi, m 2 , . . . , mga) using 
block-by-block backward decoding. Similarly, we only consider the decoding of (mi, m%, . . . , m B 2_ B _ L ), 
since (m B 2_ B _ L+1 , m B 2_ B _ L+2 , . . . ,m B i) are all dummy messages according to (26). 

• a) Node n + 2 first finds the unique lv n+2 ,B 2 -L = {k,B 2 -L,i G £>„+2} such that there exists some 
lvl+2 b 2 ~l+i satisfying that for any block j = B 2 - L + 1, B 2 - L + 2, . . . , B 2 , 

0^-o,j( r nj\ m j-B), Xij(mj_B), {(Xjj^jj-i), Yij(lij\lij-i)) : i G £>ri+2}, Y n+2 j) 

), (30) 



where, similarly, rrij and rrij_ B are both dummy messages according to (26), and X j(mj|mj_s) 
and Xi^mj-s) are both known at node n + 2. Still, from the proof of [1181 Thm 2.7], lv n+2 ,B 2 -L 
can be decoded if 



^PCs! Yr> n+2 \s, Y n+2 \X , Xx, X Vn+2 \ s ) — I(Y S ; Y S \X , X 1 ,X T , n+2 , Y n+2 , Fx> n+2 \ l s) 



>0, 



(31) 
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for any nonempty S C V n+2 . 
b) Backwardly and sequentially from block j 
pair (rrij-B, h n +2j-i 



B 2 — L to j = 1, node n + 2 finds the unique 
satisfying (30), where 1%, +2 j has already been recovered due to the backward 

' B 2 



L,B 2 — L — 1, 



property of decoding, and either is a dummy message (for j 

L + 1) or has been decoded due to the backward property of decoding (for j = B 2 — B 
B-L-l,...,l). 

At each block j ' = B 2 — L, B 2 — L — 1, . . . , 1, error occurs with mj_ B if the true m,_ B does not 
satisfy (30) with any l-D n+2 ,j-i, or a false iiij_ B satisfies (30) with some lv n+2 ,j-i- According to the 
properties of typical sequences, the true (mj^ B ,lv n+2 ,j-i) satisfies (30) with high probability. 



For a false mj- B and a l-D n+2 ,j-i with false {kj-i } i G S} but true G V n+2 \ S}, 

~^-o,j( m j\ m j-B) and Xij(mj_s) are independent of {p^ijihj-^^i^ihjlhj-i)) '■ i ^ ^n+2} and 
Y n+2 ,j; and {(Xij^-i), Yij(iij|iij-i)) : « G 5} are independent of {(X^^-i), Y^^ijl^i)) : 
* e P n +2 \5} and Y n+2 j. 

Therefore, the probability that such false (rrij,l- Dn+2: j_ 1 ) satisfies (30) can be upper bounded by 



2 T(H(X ,X 1 ,X I , n+2 ,Y Vn+2 X n +2)+e) 2 -T(H(X T , n+2XS ,YT, n+2 \ S ,Y n+ 2)-e) 
x2 -T(H(Xo,X 1 )-e)2~T(H(X s )-e) 2 ~T(Y. ie s( H &\ X i)-£)). 

Since the number of such false {Trij,lx> n+2l j-i) is upper bounded by 2 TR Yli^s 2 T ^^ Yi ' Y ^ x ^ +e \ with 
the union bound, it is easy to check that the probability of finding a false rrij goes to zero as T — > 00, 
if 

R < min I(X , Xi, X s ; Y Vn+2 \ s , Y n+2 \X Vn+2 \ s ) - I(Y S ; Y S \X , X\, X Vn+2 ,Y n+2} Y Vn+2 \ s ). (32) 



Similarly, based on the recovered rrij and lv n+2 ,j, lv n+2 ,j-i can be decoded if (31 ) holds. 

By a) and b) together, at the end of all B 2 block, the destination node n + 2 can decode messages 



(mi, m 2 , • • • , rn B 2) if both (31 ) and (32) hold. 



Combining i) and ii), and using the standard technique of time sharing, we conclude that the rate 



described in (22)-(24) is achievable. 



B. Multiple D-F relay nodes (M > 2) 

When there are multiple D-F relay nodes, i.e., M > 2, a total of B M+1 blocks will be used. The 
detailed codebook generation and encoding/decoding process are as follows. 

Codebook Generation: Fix p(x )p(x M \x ) YlieM\M P( x i)p(yi\Uii x d- We randomly and independently 
generate a codebook for each block. 

i) First consider the codebook generation for nodes 7r(l : M + 1). 

• For each block b G [1 : B M+1 ], backwardly and sequentially for each relay node ir(k),k = M + 
1, M, . . . , 2, randomly generate 2 TR conditionally independent sequences 

x 7r (fc),fe(m 6 _ B fc-i|m b _ B fe, . . . , m h _ B u) : 

where m b _ B k-i,m b _ B k, . . . ,m b _ B M G [1 : 2 TR }\ 

• For each block b G [1 : B M+l ] and node 7r(l), i.e., the source node 0, randomly generate 2 TR 
conditionally independent sequences yL fi(m b \m b _ B , . . . ,m b _ B M), where 

m b , m b - B , . . . , m b _ B M G [1 : 2 TR \. 

ii) The codebook generation for the nodes in M \ M. is the same as that in the case of M = 1. For 
each block b G [1 : B M+l ] and each relay node i E M \ M, randomly and independently generate 2 TRi 
sequences x-i : b(k,b-i), k,b-i £ [1 : 2 TRi ], where Ri = I{Yi] Yi\Xi) + e; for each relay node i G Af\M and 
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each Xj j 6(Zi i 6_i), li )b -i G [1 : 2 TRi ], randomly and conditionally independently generate 2 TRl sequences 

YifiikAhh-i), Kb e [1 : 2 Tk % 

The combination of i) and ii) defines the codebook for any block b G [1 : B M+1 ], 

C b = |x ff ( fc ) )6 (m 6 _ fl k-i|m 6 _ B k,. . .,m b _ B M) : m b _ B k-i,m b _ B k, . . .,m b _ B M G [1 : 2 Tfl ], A; = M + 1, M, . . . , 2; 
x , b (m b |m fe _ B) . . . ,m fe _ B M) : m fe ,m fe _ B , . . .,m b _ B M G [1 : 2™]; 

^,b(k,b-i),yi,b(k,b\kb-i) ■ k,bJi,b-i e [1 : 2™<],2 g A/"\m}- (33) 

Encoding: Let m = (mi,m2, . . . ,m B M+i) be the message vector to be sent and let mj, = 1 be the 
dummy message for any 

b G U^[wB - L + 1 : wB] \J U™ =1 uf^" [v(B - l)B u + 1 : vB u+1 ], (34) 

and for any b < 0. Now, the actually achievable rate is ^ B -^(^ B Z ^) M R due to the dummy messages, which 
can still be made arbitrarily close to R by letting B — > oo for any L and M. 

i) We still first consider the encoding process for nodes n(l : M + 1). 

. In block b G [1 : B M+1 ], node tt(1), i.e., the source node 0, transmits x 0tb (m b \m b - B , . . . ,m b _ B M). 

. By the end of block vB h -\ v G [1 : B M+1 /B h - 1 ], the D-F relay node n(k), k = 2, . . . , M + 1, 
has decoded messages (m 1 ,m 2 , . . . , m vB k-i) using backward decoding (see the decoding part). In 
the next B^ 1 blocks, i.e., in block b G [vB^ 1 + 1 : (v + l)S fc_1 ], node 7r(/c), fc = 2, . . . , M + 1, 
transmits x^^m^^-i \ m b-B k i ■ ■ ■ , mbs* 1 ), where 

(m b _ B k-i,m b _ B k, . . .,m b _ B Ai),b G [vB^ 1 + 1 : (v + l)^ -1 ] 

have all been decoded by block vB^ 1 . 

ii) The encoding process for the nodes in J\f \ Ai is still the same as that in the case of M — 1. For 
any block b G [1 : B M+1 ], each relay node i G M \ Ai, upon receiving at the end of block b, finds 
an index l i>b such that 

(xi i6 (ii,6_i),yt,6,yi 1 6(/i ) 6|/i,6-i)) G A e (Xi,Yi,Yi), 

where l ij0 = 1 by convention. In block b G [1 : £> M+1 ], the relay node i E M\M transmits x ii6 (Zj )6 _i). 

Decoding: At the end of block b = vB k ~\ v G [1 : S^+VB*" 1 ], the node tt(A;), fc = 2, . .'. , M + 2, 
decodes messages (m b _ B k-i +1 , . . . , m b ) using block-by-block backward decoding as follows. 

i) The node ir(k), k = 2, . . . , M + 2, first finds the unique lv k ,b-L — {k,b-L, i £ sucn mat there 
exists some Z|, b _ i+1 satisfying that for any block j = b — L + l,b — L + 2, . . . ,b, 

(X 0j j(mj\mj-B, ■ ■ .,mj_ B M), 

{3L,r( s )j{mj-B<>-A m j-B*, ■ ■ ■ ,mj_ B M),s = 2, . . . , k - 1, k, k + 1, . . . , M + 1}, 

{\^i,i(hj-i)^i,j{kj\k,j-i)) '■ i G %})Y^((s)j) G A e (X , X^, ix> fc , Y w ^). (35) 

Note in ( [35] ), (mj,rrij- B , . . . ,rrij_ B M),j = 6 — L + 1, 6 — L + 2, . . . , b are all dummy messages according 
to (34), and thus X^^w, s = 1, . . . , M + 1 are all known at node 7r(fc). Then, it follows from the proof 
of IU8l Thm 2.7] that lv k ,b-L can be decoded if 

I(X S ; Y-D k \s, Yir(k)\Xir(i:M+i), X-D k \s) - I(Y S ; YslX^i-M+i), Xv k ,5^r(fc), ix> fc \s) > ; (36) 

for any nonempty S CV k . 

ii) Backwardly and sequentially from block j = b—L to j = b—B k ~ 1 +l, node ir(k), k = 2, 3, ... , M+2, 
jointly decodes the message transmitted by its immediate upstream node n(k — l), and the compressions of 
the C-F relay nodes. Specifically, node n(k), k = 2, 3, . . . , M + 2 finds the unique pair (mj_ B k-2,lx> k ,j-i) 
satisfying (35); node n(k),k = 2, finds the unique pair (mj,lx> k ,j-i) satisfying (35). Note here the 
exception for node ir(2) arises because the source node ir(l) transmits rrij rather than m,-_i in block j, 
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but the ideas of the decoding processes at all ir(k), k = 2, 3, . . . , M + 2, are exactly the same. Thus, 
below, we only present the decoding at node n(k), k — 3, 4, . . . , M + 2, while the decoding at node 7r(2) 



can be easily obtained by analogy. The same consideration also applies to the proof in |IV-B| 

In (35), lx> k ,j has already been recovered due to the backward property of decoding, and among the 



messages (rrij, rrij^s, ■ ■ ■ , rrij_ B M), only rrij_ B k-2 is the unknown message at node ir(k) that needs to 
be decoded in block j. In fact, (m,_ B fc-i, . . . ,rrij_ B M) have been decoded by block b — B k_1 , while 



(rrij, . . . , mj_ B k-:i) either are dummy messages according to (34) (for block j — b — L, b — L— 



B h 2 — L + 1) or have been decoded due to the backward property of decoding (for block j = b — B 



k-2 



L,b- B k - 2 — L — 1, . . . ,b — B k - 1 + 1). 



At each block j = b — L,b — L — 1, . . . , 6 — B +1, error occurs with m rj _ B k-2 if the true rrij_ B k 



does not satisfy (35) with any lx> k ,j-i, or a false rrij_ B k-2 satisfies (35) with some lv k j-i- According to 
the properties of typical sequences, the true (rrij- B k-2, lv k ,j-i) satisfies (35) with high probability. 



For a false rrij_ B k-2 and a h k ,j-i with false {k } b-i,i £ $} but true {ti^-i,i G V k \ S}, 

{X 7r (i)j(mj|mj_.B, . . . ,m J -_B-w),X 7r ( a ) ) j(m 3 -_B*-i|rn.j-B» 3 • • ■ , w,_ b m), s = 2, . . . , k - 1} 
are conditionally independent of {(Xy(Zij_i), Yj j-i)) : « G ^Cfc} and Y 7r ( fc ) J given 

{X^( s ) ii (m ;/ _B*-i|m 3 -_B*, • • ■,m j _ B M), s = k, . . . , M + 1}; 
and {(Xij(iij_i), Yjj(/ij|/jj_i)) : j G 5} are independent of 

{(Xij(Zij_i), Y jlkj^i)) : z G P fc \<S},{X 7r ( s ) )i (m i _ BS -i|m J _ Bs ,...,m i _ B M),s G [A; : M+l]}, Y^j. 



Therefore, the probability that such false (mj_ B k-2,lx) k ,j-i) satisfies (35) can be upper bounded by 

2T(H(X 7T ( 1 . M+1 - j ,X T>k ,Y T , k ,Y w ( k ))+e)2-T(H(X n ( k . M+1 ),X T>k \ S ,Y'D k \s> Y Tv(k))- e ) 
x2 -T(H(^ (1:fe _ 1) [X l(fc:M+1) )- £ )2-T(ff(X s )-e)2-re ieS (if(7 i |J i )-6)) > 

Since the number of such false (rrij_ B k-2, lv k ,j-i) is upper bounded by 2 TR Ylies 2 T ^ I( ~ Yt ' Y ^ x ^ +t \ with the 

union bound, it is easy to check that the probability of finding a false rrij_ B k-2 goes to zero as T — > oo, 
. f 

R < mm X 5 ; lx> fe \5, y^-^lX^^, ^(fcM+i)) - I(Xs\ Xs|^7r(i:M+i), Xx> k , Y^^^Yv^s)- (37) 



scv k 



Then, based on the recovered rrij_ B k-2 and from the proof of [18, Thm 2.7], it follows that lv k ,j- 



can be decoded if (36) holds. 



Combining i) and ii), using the technique of time sharing, we obtain the achievable rate (19)-(20l. 



IV. Unified Relay Framework With 5-Blocks-By-I?-Blocks Backward Decoding 

Under the unified relay framework using nested blocks and backward decoding, we can also consider 
combining the noisy network coding scheme Ifl6l with the multi-level D-F scheme. However, since noisy 
network coding uses repetitive encoding/all blocks united decoding, to make it fit into our framework, 
a modification is needed. Specifically, assume some fixed M. C M with \M\ = M and vr({0, Ai,n + 
1}), and a total of B M+1 blocks are used. The source can still repetitively encode intra- £>-blocks as 
in [fT6ll . but inter- B -blocks, the source has to cumulatively encode to allow for the operation of D-F 
strategy; Correspondingly, both the D-F relay nodes and the destination will perform £>-Blocks-By-£>- 
Blocks backward decoding, which is essentially a combination of backward decoding and B blocks united 



decoding. Same as in Section III the backward decoding at node n(k), k = 2, 3, . . . , M + 2, will happen 



at the end of every B k ~ l blocks, i.e., at the end of block b = vB^ 1 ,v G [1 : B M+l j 'B k ~ x \, and both the 
D-F relay nodes and the destination node perform compression-message joint decoding. Below, we still 
first consider the case of single D-F relay node (M = 1) to illustrate the main idea, and then extend it to 
the general case of multiple D-F relay nodes (M > 2). 
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A. Single D-F relay node (M = 1) 

Still assume that only node 1 is the D-F r elay node, and all other relay nodes are the C-F relay nodes, 
and let J\ := J\f\ {1}. Specializing Theorem |2.2| to this case, we have that a rate R is achievable, if there 
exists some 

p(q)p(x \q)p(xx\x , q) JJ p(xi\q)p(yi\yi, x h q), 

such that 



R < min 



max min I(X , X s ; Y Tl \s, Y 1 \X U X Tl \s, Q) ~ I{Y S ; Y S \X , X u X Tl , Y u Y Tl \s, Q), 
TiCAT^cri 

max. min I(X , X u X s ; Y Tn+2 \ s , Y n+2 \X Tn+2 \ Sl Q) - I(Y S ; Y S \X , X u X Tn+2 ,Y n+2 , Y Tn+2 \ s , Q). 



(38) 

Still, a total of B 2 blocks will be used. The detailed codebook generation and encoding/decoding process 
are as follows, which can be understood with the help of Table |nj 

table n 

B-BLOCKS-BY-B-BLOCKS BACKWARD DECODING FOR THE SINGLE D-F RELAY NODE CASE 



Block 1 2 ■ ■ ■ B - 1 B 



X 


xo,i(mi|l) 


xo,2(mi|l) 


xo,b-i(wh|1) 


x ,s(mi|l) 


Yi 











mi 


X X 




xi,2(l) 


xi,s-i(l) 


xi,b(1) 


Y X 


y^-.i^il 1 ) 


^,2(^,21^,1) 






X X 


^.iC 1 ) 


X AT, 2(W,l) 


x JV',B-l('./V',B-2) 


x A/',b('a/',B-i) 


Y n+2 















Block B 2 - B + 1 B 2 - B + 2 ■ ■ ■ B 2 — I B 2 



X 


x O,Bi»-.B+l( 1 l'™B-l) 


X 0B 2_ s+2 ( 1 l m S-l) 


x 0,s2-i(l|™B-l) 


x 0,B 2 ( 1 l m B-l) 


Yi. 











m B 


X! 


x 1S 2_ s+1 (m s _i) 


x i,B 2 -B+2( m B-i) 


x l,B 2 -l( m B-l) 


x l,B 2 ( m B-l) 




yAf,B 2 -B+l( l Af,B 2 -B+l\ l Ar,B 2 -B^ 


yAA,B 2 -S+2('A/',B 2 -S+2l'AA,S 2 -B + l) 


yA^,B 2 -l( / JV,B 2 -ll^,B 2 -2) 


y/j,B 2 ^J\f.B 2 ^Af.B 2 — !^ 




X A/\B 2 -B + l('A r ,B 2 -s) 


X Af,B 2 -B+2 ^AT.B 2 -B+V 


x jv',b 2 -i('a',b 2 - 2 ) 


x jv , ,b 2 ('a^,b 2 -i) 


Y n+2 











(roi.mj, . . . ,m B ) 



Codebook Generation: Fix p(x )p(xi|a;o) n^sAf ^(^M^l^' We randomly and independently gen- 
erate a codebook for each block. 

i) First consider the codebook generation for the source node and the D-F relay node 1. Denote 
f(b) := [4], i.e., the smallest integer greater than or equal to -|. For each block b E [1 : B 2 ], randomly 
generate 2 TBR independent sequences x.i t b(mf(h-B)) f° r node 1, and randomly generate 2 TBR conditionally 
independent sequences xo ) b(m/(b)|m/(b_ j B)) for node 0, where mfo,), m/(&_B) E [1 : 2 TBR ]. 



ii) The codebook generation for the C-F relay nodes is exactly the same as that in Section III For 
each block b E [1 : B 2 ] and each relay node i E Af, randomly and independently generate 2 TRl sequences 
*i,b(h,b-i), h,b-i £ [1 : 2 TRi ], where Ri = 1(1^; Y\Xi) + e; for each relay node i E N and each x i)b (^ )6 _ 1 ), 
Ub-i G [1 : 2 TRi ], randomly and conditionally independently generate 2 TRi sequences yib(kb\kb-i), 
kb e [1 : 2 T % 

The combination of i) and ii) defines the codebook for any block b E [1 : B 2 ], 



C b = |x lj6 (m / (6-B)),Xo l6 (m / ( 6 )|m / ( 6 _ B )) : m /(6) , m /(b _ B) E [1 : 2 TBR }; 

Xi,b(kb-i),yi,b(kb\kb-i) ■ kb,k,b-i e [1 : 2 TR %% E A/"}. (39) 
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Encoding: Let the message vector to be sent be 

m = (mi, mi, . . . ,m 1 ,m 2 ,m 2 , . . . ,m 2 , . . .,m B ,m B , . . .,m B ). 



B B B 



Let m B = 1 be the dummy message, i.e., m/(&) = 1 for any 

fee [(5-1)5 + 1 :B% (40) 



and for any b < 0. The actually achievable rate is ^-^R due to the dummy messages, which, however, 
can be made arbitrarily close to R by letting B — > oo. 

i) First consider the encoding process for nodes and 1. 

• In block b G [1 : B 2 ], the source node transmits x j(b)(m/( 6 )|m/(&__B))- 

• At the end of block vB, v G [1 : B), the D-F relay node 1 has decoded messages m v using B blocks 
united decoding (see the decoding part). In the next B blocks, i.e., in block b G [vB+1 : (v+l)B], the 
relay node 1 transmits Xi ib (m/(&_B)), where mj( b „ B ) for any 6 G [uB + 1 : (f + 1)5] is corresponding 
to m v ) that has been decoded by block vB. 

ii) For any block b G [1 : B 2 ], each relay node i G A/, upon receiving at the end of block b, finds 
an index l i:b such that 

( x i,&(^,6-l); yi,6> yi,b(k,b\h,b-l)) G ^.ePQ, Vi, 5^) , 

where Z^o = 1 by convention. In block 6 G [1 : £> 2 ], the relay node i E ftf transmits x^^-i). 

Decoding: We present the decoding process at the D-F relay node 1 and at the destination node n + 2 
separately. 

i) At the end of block b = vB, v G [1 : B], the D-F relay node 1 decodes messages m v using B blocks 
united decoding, i.e., it finds the unique m v , such that there exists some ^r v _^ B+l satisfying that for 
any block j = (v - l)B + 1, (v - l)B + 2,...,vB, 

(Xo yj (m m \m f{j _ B) ),X hj (m f{j ^ B) ) 

{{X^jih.j :).¥,.,(/,,/,., ;)) : % G A^}, Y w ) G A e (X , X x , A>, Y#, Y x ), (41) 

where m/^-B) is corresponding to m„_i and has been decoded by the end of block (v — 1)B, and rrifu) 
is corresponding to m v . From [fT6l Thm 1] and its proof (see also [fT8l Thm 2.4]), we have that m v can 
be decoded if 

R < min I(X , X s ; Y^ s , Y x \X^ S , X,) - I(Y S ) Y S \X , X u X^, Y u Y^ s ). (42) 



Note, (42) can be improved by considering only a subset 71 Q J\ for the decoding while treating the 
inputs of other C-F relay nodes as purely noise, leading to following more general rate constraint: 

R < max min I(X , X s ; Y Tl \ s , Y^X^s, X x ) - I(Y S - Y S \X , X u X Tl , Y u Y Tl \ s ). (43) 

TiCArSCTi 

ii) At the end of all B 2 block, the destination node decodes all messages (mi, m-2, . . . , m B ) using B- 
Blocks-By-5-Blocks backward decoding. In fact, since m B = 1 is dummy message, only (mi, m 2 , . . . , m B - X ) 
need to be decoded. For this, backwardly and sequentially for g = B — 1,B — 2,...,1, node n + 2 finds the 
unique m g such that there exists some satisfying that for any block j = gB + 1, gB+2, . . . , gB+B, 

(X 0J (m /(j) |m /0 -_ B) ),Xij(m /(i _ B) ) 

{(Xijh.j ;).¥,.,(/,,/,., ,)) : i G A/"}, Y n+2J ) G A e (X , X x , X^, Y#, Y n+2 ). (44) 



Note in (44), for j = gB + 1, gB + 2, . . . , gB + B, only m/(j__B), corresponding to m g , needs decoding; 
and mj(j), corresponding to m fl+ i, either is a dummy message (for g = B — l, i.e., j = (B — \)B + 1,(B — 
1)B + 2, . . . , B 2 ), or has been decoded due to the backward property of decoding (for g = B — 2, . . . , 1). 
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Thus, Xq and X\ are cooperatively transmitting the message m g , and similarly as above, m g can be 
decoded if 

R < min I(X Q , Xt, X s ; Y^ s , Y n+2 \X^ S ) - I(Y S ; Y S \X , X u Xj?, Y n+2 , Y^ s ). (45) 

SCAT x x x 



Also, (45) can be improved by considering only a subset T n +2 for the decoding, leading to the following 



rate constraint: 



R < max min I(Xq, Xi, Xs]Yj- n+2 \s,Y n+ 2\Xj- n+2 \s) — I(Ys] Ys\Xq, Xi, Xj- n+2 , Y n j r 2 : ^t^ +2 \s)- 



(46) 



Combining (43) and (46) and using the technique of time sharing, we have that the rate in (38) is 
achievable. 

B. Multiple D-F relay nodes (M > 2) 

Codebook Generation: Fix p(x Q )p(x M \x ) Y\.%^m\m p{xi)p{yi\yi-, X{). We randomly and independently 
generate a codebook for each block. The codebook generation for the C-F relay nodes is exactly the 
same as that in III and IV-A[ and hence omitted. We only present the codebook generation for nodes 
7r(l : M + 1). Still, denote f(b) := |~-|], i.e., the smallest integer greater than or equal to -|. 

• For each block b G [1 : B M+1 ], backwardly and sequentially for each relay node ir(k),k = M + 
1, M, . . . , 2, randomly generate 2 TBR conditionally independent sequences 

X-TT(k),b('m>f(b-B k - 1 )\ m f(b-B k )i • • • i W/(6-B«)), 

where m /(6 _ B *-i), m f{b _ Bk) , m f{b _ BM) G [1 : 2 TBR ]. 

• For each block b G [1 : 73 M+1 ] and node 7r(l), i.e., the source node 0, randomly generate 2 TBR 
conditionally independent sequences 

x o,6(w/( 6 )|m/( 6 _ B ), . . . ,m /(fe _ B M)), 

where m/(6), m/( 6 _ S ), . . . , rrif(b-B M ) £ 

[1 : 2™]. 

The above, together with the codebook generation for the C-F relay nodes, defines the codebook for any 
block 6 G [1 : 5 M+1 ], 

= { x TT(k),b(fnf(b~B k - 1 )\ m f{b~B k ), ■ ■ ■ , m f(b~B M )) '■ m f(b-B k -^)i ■ ■ ■ , m f{b~B M ) £ [1 : 2 TBR ],k = M + 1, M, 
*o,b{ m f{b)\ m f(b-B)-, ■ ■ ■ ,rnf(b-B M )) '■ m f(b),mf(b~B), ■ ■ ■ -,?nf(b-B M ) £ [1 : 2 TBR ]; 
^i,b(kb-i),yi,b(k,b\kb-i) ■ h,b,kb-i e [1 : 2 m ],i 6#\M}. 

Encoding: Let the message vector to be sent be 

m = (mi, mi, . . . , mi, m 2 , m 2 , . . . , m 2 , • • • , m B M ,m B M , . . . ,m B u). 

V v ' S v ' V v ' 

B B B 

Let m/(6) = 1 be the dummy message for any 

b G Uf =1 UC[' U [v{B - l)B u + 1 : vB u+ \ (47) 

and for any b < 0. The actually achievable rate is ( B ^) M R due to the dummy messages, which can still 
be made arbitrarily close to R by letting B — > oo for any M. 



The encoding process for the C-F relay nodes is still exactly the same as that in III and IV-A and 
hence omitted. We only present the encoding process for nodes ir(l : M + 1). 

• In block b G [1 : B M+1 ], the source node transmits x 0) &(m/(6)|m/(&_.B), . . . ,mf^-BM)). 
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. At the end of block vB k ~ l ,v G [1 : B M+1 /B k ~ 1 }, the relay node ir{k), k = 2, . . . , M+l, has decoded 
messages (m l5 m 2 , . . . ,m vB k-2) using backward decoding (see the decoding part). In the next 
blocks, i.e., in block b G [v B^ 1 + 1 : (y + the relay node ir(k), k — 2, . . . , M+ 1, transmits 

X 7r(fe),6(W/(6-B fc - 1 )l m /(6-B fc )) • • • i m f(b-B M ))i 

where (rnfn ) -.Bi>- 1 )>' m >f(b-B k )i ■ ■ ■ , m f(b~B M )) f° r an Y b G \vB k ~ l + 1 : (y + l)B k ~ l ] have all been 
decoded by block vB^ 1 . 

Decoding: At the end of every B^ 1 blocks, the node ir(k), k = 2, . . . , M + 2 decodes B k ~ 2 mes- 
sages using £>-Blocks-By-£>-Blocks backward decoding. (Note every B k ~ x blocks carry B k ~ 2 messages.) 
Specifically, at the end of block b = vB k ~\ v G [1 : B M + 1 /B k ~ 1 }, the node 7r(Jfe), fc = 2, . . . , M + 2, de- 
codes messages (m^ v _ 1 - )B k-2 +1 , . . . ,m vB k-2). In fact, (m vB k-2_ B k-3 +1 , . . . ,m vB k-2) are dummy messages 
according to (47), and only (mr v -i)B k -*+i> ■ ■ ■ > fn vB k-2_ B k-z) need decoding. For this, backwardly and 
sequentially for g = vB k ~ 2 — B k ~ 3 , vB k ~ 2 — B k ~ 3 — 1, . . . , (u — l)B k ~ 2 + 1, node 7r(k) finds the unique 
ra g such that there exists some Z^tf ( g -i)B+B k - 2 +i sat i s fy m g tnat f° r an Y block j = (g — 1)B + B k ~ 2 + 
1, (g - 1)B + B k - 2 + 2, . . . , gB + B^- 2 , 

(X 0ii (m /(i) |m /(i _ B) , . . . ,m /(i _ B M)), 

{X^s^m/^Ba-i^m/^-Bs), . . . ,m/(j_ B M)),s = 2, . . . , - 1, fc, + 1, . . . , M + 1}, 
{0^i,j(h,j-i),^ij(h,j\h,j-i)) '■ i G A/"\ A'!}, Y 7r(i .) J -) G 4(^0, ^M, ^Af\M, (48) 
where (m/y), mf^_ B ), . . . ^/(j-BM),™/^"), i n f(j-B k - 1 )j ■ ■ ■ > m f(j-B M )) are corresponding to 

(m g+B k-3,m g+B k-3_ 1 , . . . , m g+B k-3_ B k-4,m g , m g+B k-3_ B k-2 } . . . , m g+B k-3_ B M-i) (49) 



Among the messages in (49), only m 9 , corresponding to mf(j_ B k-2\, is the unknown message at node 
7r(/c) that needs to be decoded. In fact, 

(m g+B k-3_ B k-2 } . . . , m g+B k-3_ B M-i) } corresponding to (mf^_ B k-i^ } . . . ,niffj^ B M\), 

have been decoded by block 6 — i?* -1 , while 

(m g+B k-3, mg +S fc-3_ 1 , . . . , m g+B k-3 - B k-4), corresponding to (m/y), m/y_ B ), • • • , m fij _ B k-3)), 

either are dummy messages according to (47) (for <? = vB k ~ 2 — B k ~ 3 , . . . , vB k ~ 2 — 2B k ~ 3 + 1) or have 
been decoded due to the backward property of decoding (for g = vB k ~ 2 — 2B k ~ 3 ,vB k ~ 2 — 2B k ~ 3 — 
1, ...,(« - l)5 fc - 2 + 1). Therefore, in @, 

{X^-, s = k, k + 1, . . . , M + 1} 

are known at node z(k), while 

{ X 7T( S )J, s = 1, . .. , k - 1} 

are cooperatively transmitting the message m g . Having noted this fact, from [fT6l Thm 1] and its proof 
(see also lfT8l Thm 2.4]), we have that m g can be decoded if 

R < min J(X(i : fc_i), X s ; Y(n\m)\s, Yn(k)\X(mM)\s, X(k-.M+i)) - I(Y S ; Y s \Xr 1:M +i), Xjy\ M , Y n ^ k) ,Y^\ M - } \ S ). 

SC.J\f\M 

(50) 

By considering only a subset % Q M \ M. for the decoding at node n(k) while treating the inputs of 
other C-F relay nodes as purely noise, and using the technique of time sharing, (50) can be improved to 

R < max min J(Jr 7r (i.fc_i), X$; Yj- k \s, Y^^lX-j-^s^ X^^-m+i), Q) ~ I(Ys] Yg\X n ^i-M+i), X-f k , Y n ^j, Yj- k \s, Q), 

T k CJV\M SCTk 

(51) 



which proves Theorem 2.2 
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V. Conclusion 

We have proposed a unified relay framework with both the D-F and C-F relay nodes for multiple-relay 
channels. This framework employs nested blocks combined with backward decoding to allow for the full 
incorporation of the best known D-F and C-F relay strategies. The achievable rates obtained under such 
a framework turn out to combine both the best known D-F and C-F achievable rates and include them as 
special cases. 
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